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VIDEO CODING .METHOD AND DECODING 
METHOD AND DEVICES THEREOF 

BACKGROL"ND OF TOE INVENTION 

1. Held of che Inveauon 5 
This invention can be used Ln low bit rate video coding for 

teie -communicative applications. It improves the temporal 
frame rare of the decoder output as well as the r^trail picture 
quality. , c 

2. Related art of the Invention 

In a typical hybrid (ransform coding algorithm such as she 
ITU-T Recommendation H.261 [11 and MPEG [2\ motion 
compensation is used to reduce the amount of tempcrai 
redundancy in Che sequence. In che coding scheme - 

the frames are "coded using only forward prediction, here- 
after referred to as P- frames. In the MPEG coding scheme, 
some frames are coded using bt-direction prediction, here- 
after referred to as B- frames. B-frames improve the erS- 
ciency of the coding scheme. Now the [ i [ ts HU-T Rec- :c 
ommendarion H.261 (Formerly CC1TT Recornmeadation 
H.261; Codes for audiovisual services at p:<64- kbit/'s 
Geneva. 1990 . and the [2 1 is ISO/TEC II 172-2 1993 . 
Information technology — Coding of moving pictures and 
: associated audio for digital storage media at up co about 1.5 25 
Mbitfs - Pan 2: Video. 

However, ic introduces delay in the encoding and 
decoding, making ic unsuitable for applications in the com- 
municative services where delay is an important parameter. 
FIG. la and lb illustrates the frame prediction of H.261 and 30 
MPEG as described above. A new method of coding involv- 
ing the coding of the P and B frames as a single unic 
hereafter referred to as the PB- frame, was introduced- In this 
scheme the blocks in the PB-frames are coded and trans- 
mitted together thus reducing the toz^i delay. In fact the total 33 
delay should not be more than a scheme using forward 
prediction only but at half the frame rate. 

FIG. 2a shows the PB-frame prediction. A PB- frame 
consists of two pictures being coded as one unit. The aame ^ 
PB comes from the name of picture types in MPEG where 
there are P-frames and B-frames. Thus a PB-frame consists 
of one P-frame which is predicted from the last decoded 
P- frame and one B-frame which is predicted both from the 
last decoded P-frame aad the P-frame curreadv being . 

45 

decoded. This last picture is called B-rrame because pans or 
it may be bi-directionally predicted from the past and future 
P- frame. 

FIG. 2b shows the forward and bi-directional prediction 
for a block in the B- frame, hereafter refined to as a 3 -block. 50 
Only the region that overlaps with the corresponding block 
in the current P-frame. hereafter referred to as the P-btccsL 
is bi-directionally predicted The rest of the B-clock is 
forward predicted from the previous frame. Thus only the 
previous frame is required in the frame store. The informa- ^ 
uoq from the P-frame is obtained from the P -block currently 
being decoded, 

Cn the PB -block only che motion vectors for the P-block 
is transmitted to the decoder. The forward and backward 
motion vectors for the B-blocs is derived from the P motion 
vectors. A linear motion model is used aad che temporal 
reference of the 3 and ? nramc is used to scale the motion 
vector appropriately. FIG. 3u iepicts the: motion vector 
scaling and the formula is shown below. 

si 
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where 

MV is chc motioQ vector of the P-block. 

MV r and MV 5 are the forward and backward motion 

vectors for the B-block. 
TR^ is the increment in the temporal reference from the 

last P- frame to the current B- frame, and 
TR P is the increment in the temporal reference from the 
last P-frame to the current P-frame. 
to Currently the method used in the prior an assumes a linear 
motion modeL However this assumption is not valid in a 
normal scene where the motion is typically not linear. This 
is especially true when the camera shakes and when objects 
are not moving at constant velocities. 
15 A second problem involves the quantization and trans- 
mission of the residual of the prediction error in the B-block 
Currently the coefficients from the P-biock and the B-biock 
arc interleaved in some scanning order which requires the 
B-block efficients to be transmitted even when they are all 
2Q zero. This is not very efficient as it is quite often that there 
are no residual coefficients to transmit (all coefficients are 
zero). 

SUMMARY OF THE INVENTION 

In order to solve the first problem, the current invention 
employs a delta motion vector to compensate for the non- 
linear motion. Thus it becomes necessary for the encoder to 
perform an additional motion search to obtain the optimum 
delta motion vector that when added to the derived motion 
veaors would result in the best match in the prediction This 
delta motion vectors are transmitted to the decoder at the 
block level only when necessary. A Sag is used to indicate 
•to the decoder if there are delta motion vectors present for 
the B-biock. 

For the second problem, this invention also uses a flag to 
indicate if there are coefficients for the B-biock to be 
decoded. 

The operation of the Invention is described as follows. 
FIG. 3a shows the linear motion model used for the 
derivation of the forward and backward motion vectors from 
the P-block motion vector and the temporal reference infor- 
mation As illustrated in FIG. 36. this model breaks down 
when the motion is not linear. The derived forward and 
backward motion vector is different from the actual motion 
vector when the motion is not Linear. This is especially true 
when objects in the scene are moving at changing velocities. 

In the current invention the problem is solved by adding 
a small delta motion vector to the derived motion vector to 
compensate for the difference between the derived and true 
motion vector. Therefore the equations in ( I) and (2) are now 
replaced by equations (3) and (4). respectively. 

M TR^fW TR r - WV Ww f 3 f 

where 

\fV is the motion vector of the P-block. 
MV 0if/£fl is the delta motion vector. 
hV^'jr' and \fV 3 ' arc the new forward and backward 
motion vectors for the B-biock according to the current 
invention. 

TR fl is the increment in the temporal reference from the 
65 last P-frame to the current B -frame, and 

TR^ is the increment in the temporal reference from the 
last P-frame to the current P-frame. 



Note: Equations (3) and (4) are used for the motion vector 
in the horizontal as well as the vertical directions. Thus 
the motion vectors are in pairs and there are actually two 
independent delta motion vectors, one each for the hori- 
zontal and vertical directions. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. la Is a prior art which illustrates the prediction mode 
used in the ITU-T Recommendation H.261 Standard. 

FIG. lb is a prior art which illustrates the prediction mode 
used in the ISOTEOITC MPEG Standard. 

FIG. 2a illustrates the PB-frame prediction mode. 

FIG. 2b illustrates the B-block bi-directionai prediction 
mode. 

FIG. 2a illustrates the linear motion model. 

FIG. 3b illustrates the non-linear motion model of the 
current invention 

FIG. 4 illustrates the encoder functionality block diagram. 

FIG. 5 illustrates the B-biock bi-directional prediction 
functionality block diagram. 

FIG. 6 illustrates the decoder functionaitity block dia- 
gram. 

PREFERRED EMBODIMENTS 

The preferred embodiment of the current invention is 
described here. FIG. 4 illustrates the encoding functionality 
diagram. The present invention deals with the method for 
deriving the motion vectors for the B-block. The encoding 
functionality is presented here for completeness of die 
embodiment. 

The encoding functionality block diagram depicts an 
encoder using a mention estimation and compensation for 3 
reducing the temporal redundancy in the sequence to be 
coded. The input sequences is organized into a first frame 
and pairs of subsequent frames. The first frame, hereafter 
referred to as the I- frame, is coded independent of all other 
frames. The pain of subsequent frames, hereafter referred to ^ 
as PB-frame, consist of a B- frame followed by a P-frame. 
The P-frame is forward predicted based on the previously 
reconstructed I- frame or P-frame and the B -frame is 
bi-directionally predicted based on the previously recon- 
structed I- frame or P-frame and the information in the 4 
current P-frame. 

The input frame image sequence. 1. is placed in the Frame 
Memory 2. If the frame is classified as an I-frame or a 
P-frame it is passed through line 14 to the Reference 
Memory 3. for use as the reference frame in the motion 5 
estimation of the acxt PB-frame to be predictively encoded 
The signal is then passed through line 13 to the Block 
Sampling module 4. where it is partitioned into spatially 
aoQ-overiapping blocks of pixel data for further processing. 

If the frame is classified as an I-frame. the sampled blocks 5 
are passed through line 16 to the DCT module 7. If the frame 
is classified as a PB-frame. the sampled blocks are passed 
through line 17 to the Motion Estimation module 5. The 
Motion Estimation module 5 uses Lnf ormation from the 
Reference Frame Memory 3 and the current block 17 to t 
obtain the motion vector for that provides the best match for 
the P-blockThe motion vector and the local reconstructed 
frame. 12. are passed through line 19 and 20. respectively, 
to the Motion Compensation module 6. The difference 
image is formed by subtracting the motion compensated o 
decoded frame. 21. from the current P-block. 15. This signal 
is then passed through line 22 to the DCT module 7. 
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la the DCT module 7. each Mock is transformed into the 
DCT domain coefficients. The transform coefficients are 
passed through line 23 to Quantization module 8. where they 
are quantized. The quantized coefEceats are then passed 
5 through line 24 to the Run-length 3c Variable Length Coding 
module 9. Here the coefficients are entropy coded to form 
the Output Bit Stream. 25. 

If the current block is an I- block or a P-biock. the 
quantized coefficients arc also passed through line 26 to the 
tQ Inverse Quantization module 10. The output of the Inverse 
Quantization 10. is then passed through line 27 to the 
Inverse DCT module 11. If the current block is an I-biock 
then the reconstructed block is placed, via line 23. in the 
AJ Local Decoded Frame Memory 12. If the current block is a 
P-block then the output of the Inverse DCT 29 is added to 
the motion compensated output 21. to from the recon- 
structed block 30. The reconstructed block 30. is then placed 
in the Local Decoded Frame Memory 12. for the motion 
20 compensation of the subsequent frames. 

After the P-block have been locally reconstructed, the 
information is passed again to the Motion Compensation 
Module 6. where the prediction of the B-biock is formed. 
FIG. 5 shows a more detailed functional diagram for the 
B-biock prediction process. The P- motion vector derived in 
' the Motion Estimation module 51, is passed through line 57 
to the Motion Vector Scaling Module 53. Here the forward 
and backward motion vectors of the B-blockis derived using 
30 the formula (1) and (2). respectively. In the present 
embodiment, an additional motion search around these 
vectors is performed in the Delta Motion Search module 54. 
to obtain the delta motion vector. In this embodiment the 
motion vector is obtained by performing the search for all 
delta motion vector values between -3 and 3. The delta 
motion vector value that gives the best prediction in terms of 
the smallest mean absolute difference in the pixel values of 
the B-block and the prediction block is chosen. The predic- 
ation is formed in the Bi-directional Motion Compensation 
module 55. according to FIG. 2b using the information from 
the Local Decoded Frame Memory 52. and the Current 
Reconstructed P-block 50. In the bi-directional prediction, 
only information available in the corresponding P-block is 
45 used to predict the B-biock. The average of the P-block 
information and the information from the Local Decoded 
Frame is used to predict the B-biock. The rest of the B-block 
is predicted using information from the Local Decoded 
50 Frame only. 

The prediction difference block is then passed through 
line 22 to the DCT module 7. The DCT coefficients are then 
passed through line 23 co the Quantization module S. The 
result of the Quantization module 8. is passed through Line 
55 24 to the Run-length & Variable Length Coding 9. In this 
module the presence of the delta motion vector and the 
quantized residual error in the Ourput Bicsacam 25. is 
indicated a variable length code. NOB which is the acronym 
for No B-block This Sag is generated in Run-length 3c 
60 Variable Length Coding module 9 based on whether there 
are residual error in the Quantization module 3 and delta 
motion vectors found in the Delta Motion Search module 54 
is not zero. Table' I provides the preferred embodiment of the 
variable length code for the NOB flag. The variable length 
65 code of the NOB flag is inserted En the Ourput Bitsrream. 25, 
prior to the deiu motion vector and quantized residual error 
codes. 
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TABLE I 





rVanabie length code for the NOB rtain 




Quantized Residual 


Delta Motion 


NOB 


Enwr Coded 


Vectors Coded 


0 


No 


No 


10 


No 


Yes 


no 


Yes 


No 




Yes 


Yes 
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FIG. 6 shows the functional block diagram for the 
decoder. The Input Bit Scream 31. is passed to the Variable 
Length & Run Length Decoding module 32. The biock and 
side information are extracred in this module. If the frame is 13 
a PB- frame then the bitstream is checked if any delta motion 
vector and/or quantized residual error coefficients present. 
The output of the module 32is passed through line 37 to the 
Inverse Quantisation module 33. The output of the Inverse 
Quantization 33. is then passed through line 38 to the 20 
Inverse DOT module 34. Here the coefficients are trans- 
formed back into the pixel values. 

If the current frame is an I-frame then the output of 
Inverse DCT 34. Is passed through line 39 and stored in the 
'Frame Memory 42. 

If the current frame is a PB-frame. the side Information 
containing the motion vectors are passed through line 45 to 
the Motion compensation module 36* The motion Compen- 
sation module 36. uses this Information and the information ^ 
in the Local Decoded Memory, 35, to from the motion 
compensated signal. 44. This signal is then added to the 
output of the Inverse DCT module 34. to form the recon- 
struction of the P-biock. 

The Modon Compensation module 36. then uses the 3J 
additional information obtained in the reconstructed P-block 
to obtain the bi-directional prediction for the B-biock The 
B-biock is then recoostrucred and placed in the Frame 
Memory. 42. together with the P-biock. 

By Lmpiementijig this invention, the temporal frame rate 40 
of the decoded sequences can be effectively doubled ac a 
fraction of the expected cost in bit rate. The delay is similar 
to that of the same sequence decoded at half the frame rate. 

As described above in the present invention a new pre- 
dictive coding is used to increase the temporal frame rare 45 
and coding efficiency without introducing excessive delay. 
Currently the motion vector for the blocks in the 
bi-directionally predicted frame is derived from the motion 
vector of the corresponding block in the forward predicted 
frame using a linear motion model. This however is not so 
effective when the motion in the image sequence is not 
linear. According to this invention, the efficiency of this 
method can be further improved Lf a non-linear motion 
model is used In this model a delta motion vector is added 
to or subtracted from the derived forward and backward $5 
motion vector, respectively. The encoder performs an addi- 
tional search to determine if there is a need for the delta 
motion vector. The presence of this delta motion vector in 
the transmitted bitstream is signalled to the decoder which 
then cakes the appropriate action to make use of the delta $o 
motion vector to derive the effective forward and backward 
motion vectors for the bi-directionally predicted block 

What is claimed: 

h A method for encoding a sequence of video image 
frames comprising the steps of: 65 
dividing a source sequence into a set of group of pictures, 
each group of pictures comprising a first frame 
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(I-frame) followed by a plurality of pairs of predic- 
tively encoded frames (PB-frame pairs), each PB-&ame 
pair having a corresponding P-block: 
dividing each I-frame or PB-frame pair into a pturaiiry of 

spatially non-overlapping blocks of pixel data: 
encoding the blocks from the I-frame (I-blocks; indepen- 
dently from any other frames in the group of pictures; 
oredictively encoding the blocks from the second frame of 
P £ reSme pair (P-Wocks). based on the I-blocks u 
the previous I-frame or the P-blocks in the prevtous 
PB-fnme pair, 
bi-directionally predicdvely encoding ; the blocks from the 
first frame of the PB-frame pair (B-blocks^ based on 
the I-blocks in me previous I-frame or the P-blocks in 
the previous PB-frame pair and the corresponding 
P-btcck in the current PB-frame par. 
derivin* a scaled forward motion vector and a scaled 
backward motion vector for the B-block by scaling fre 
Ltion vector of me corresponding P-block in the 
current PB-frame pair: 
obtaining a final forward motion vector for the B*ta*hy 
adding a delta motion vector to the scaled forward 
motion vector and 
* obtaining a final backward motion vector for the : B^lock 
by subtracting the delta motion vector from the scaled 
backward motioa vector. 

2. A method for encoding a sequence of video mage 
frames according to claim 1. wherein 

30 the scaling of the motion vector is based on a temporal 
reference of the first and second frames of the 

3. a'S encoding a sequence of video u^ge 

, frames according to cWm 1. «^«« ^ 

35 toLg an encoded output, wherein the encoded output is a 

bitstream comprising: 
temporal reference information for the first and second 
frames of the PB-frame pairs: 
« motion vector information for the P-blocks: 

quantized residual error information for the P-blocks: 
delta motion vector information for the B-blocks: and 
quantized residual error information for *\ 
4 A method for encoding a sequence of video unage 
45 frames according to claim 3. wherein 

the oumut bitstream contains addiuoaal information to 

uxdicate the presence of at least one of 
the delta motioa vector information for the B-blocks: and 
50 quantized residual error information for 

5. A method for decoding a sequence ot video una 3 = 
frames comorisiag the steps of: 

decoding the compressed video image ^^ ^f a 
-roup of pictures, each group ot pictures comprising m 
55 ffraL followed by a plurality of PB-trame pairs, each 
PB-frame pair having a corresponding P-bloA: 
decoding each I-frame or PB-frame pair into a plurality or 

spatiallv aon-overlapping blocks ot pixel data: 
decoding 'the I-blocks from the I-frame independently 

from anv other frames in the group of pictures: 
predictivel'v decoding the P-blocks from «=° ndtra ™; 
P of the PB-frame pair based on the I-blocks in the 
prevL I-frame or the P-blocks in the previous 
pB-rmme pair: . 
bi-directionally predictive* decoding ** ^f*^ 
the first frame of the PB-trame par based on the 
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I-blocks in the previous I-frame or the P-blocks in the 

previous PB-frame pair and the corresponding P-biock 

in the current PB-frame pair, 
deriving a scaled forward motion vector and a scaled 

backward motion vector for the B-biock by scaling the 5 

motion vector of the corresponding P-block in the 

current PB-frame pair; 
obtaining a final forward motion vector for the B-blocJe by 

voting a delta motion vector to the scaled forward 

motion vector, and 10 
obtaining a final backward motion vector for the B-block 

by subtracting the delta motion vector from the scaled 

backward motion vector. 

6. A method for decoding a sequence of video image _ 
frames according to claim 5. further comprising the step of 12 
forming a decoded output, wherein the decoded output is 
responsive to a bitstream comprising: 

temporal reference information for the first and second 

frames of the PB-frame pairs; 20 
motion vector information for the P-biocks: 
quantized residual error information for the P-biocks: 
the delta motion vector information for the B-blocks; and 
quantized residual error information for the B-biocks. 

7. A method for decoding a sequence of video image 25 
frames according to claim 6. wherein 

the bitstream contains additional information to indicate 

the presence of at least one of: 
the delta motion vector information for the B-blocks: and M 
the quantized residual error information for the B-biocks. 

8. A method of decoding a sequence of video image 
frames according to claim 5. wherein 

the scaling is based on a temporal reference of the first and 
second frames of the PB-frame pair. ^ 35 

9. An apparatus for encoding a sequence of video image 
frames comprising: 

means for encoding each frame in a sequence of video 
image frames into a set of group of pictures, each group 
of pictures comprising an I-frame followed by a plu- 40 
raliry of PB-frame pairs: 
means for dividing the I-frame and the PB-frame pair into 
a plurality of spatially non-overlapping blocks of pixel 

data; 45 
means for encoding and decoding the I-blocks of the 

I-frame independently from any other frames in the 

group of pictures: 
means for storing the decoded I-biocks to predictively 

encode subsequent frames: 5C 
means for predictively encoding and decoding the 

P-blocks of the second frame of the PB-frame pair 

based on the I-blocks in the previous I-frame or the 

P-blocks In the previous PB-frame pair: 
means for storing the decoded P-blocks to predictively 55 

encode subsequent frames; 
means for deriving a scaled forward motion vector and a 

scaled backward motion vector for a B-biock by scaling 

the motion vector of the corresponding P-biock m the 

current PB-frame pair, the B-block being the first frame & 

of the PB-frame pain 
means for obtaining a final forward motion vector for the 

B-block by adding 2 delta motion vector to the scaled 

forward motion vector: 
means for obtaining a final backward motion vector for 65 

the B-biock by subtracting the same delta moaoa 

vector from the scaled backward motion vector: and 



8 

means for encoding the B-blocks of the first frame of the 
PB-frame pairs based on the I-blocks in the previous 
I-frame or the P-blocks in the previous PB-frame pair 
and the corresponding P-block in the current PB-frame 
5 pair using the final forward motion vector and the final 
backward motion vector. 
10. An apparatus for decoding a sequence of video image 
frames comprising: 

means for decoding each frame in a sequence of video 
image frames Into a set of group of pictures, each group 
of pictures comprising an I-frame followed by a plu- 
rality of PB-frame pairs: 

means for decoding the I-biocks of the I-frame indepea- 
i3 deatiy of any other frames in the group of pictures: 

means for storing the decoded I-biocks to predictiveiy 

decode subsequent frames: 
. means for decoding the P-blocks of the second frame of 
the PB-frame pair based on the I-blocks Ln the previous 
20 I-frame or the P-blocks in the previous PB-frame pain 

means for storing the decoded P-biocks to predictiveiy 
decode subsequent frames: 

means for deriving a scaled forward motion vector and a 
. scaled backward motion vector for a B-biock by scaling 
the modoQ vector of the corresponding P-biock in the 
current PB-frame pair, the B-btock being the first frame 
of the PB-frame pain 

means for obtaining a final forward motion vector for the 
B-block by adding a delta motion vector to the scaled 
forward motion vector, 

means for obtaining a final backward motioa vector for 
the B-block by subtracting the delta motion vector to 
the scaled backward motion vector; and 

35 means for decoding the B-blocks of Che first frame of the 
PB-frame pairs based on the I-biocks in the previous 
I-frame of the P-biocks in the previous PB-frame pair 
and the corresponding P-biock in the current PB-frame 
pair using the final forward motion vector and the final 
4C backward motion vector. 

11- A method for encoding a sequence of video image 
frames comprising the steps of: 
dividing a source sequence into a plurality of groups of 
pictures, each group of pictures comprising a firS 
frame (I-frame) followed by a plurality of pairs of 
predictiveiy encoded frames (PB-frame pairs): 
dividing each I* frame or PB-frame pair into a plurality of 
blocks: 

encoding the blocks from the I-frame: 
predictiveiy encoding the blocks from the second frame of 

the PB-frame pair: 
bi-directionally predictiveiy encoding the blocks from the 
first frame of a PS- frame pair (B-biocks;: 
55 deriving a scaled forward motion veaor and a scaled 
backward motion vector for the B-block: 
obtaining a ftnai forward motion veaor for the B-biock by 
adding j delta motion vector to the scaled forward 
motion vector: and 
obtaining a final backward motion vector for the B-block 
by subtracting the delta motion veaor from the scaled 
backward motion vector. 
1Z An apparatus for encoding a sequence of video image 
$5 frames comprising: 

means for dividing a source sequence into a plurality of 
groups of pictures, each group of picrures comprising a 



45 



50 



60 



first frame (I- frame) followed by a plurality of pairs of 

predictiveiy encoded frames (PB-frame pairs); 
means for dividing each I-frame or PB-frame pair into a 

plurality of blocks; 
means for encoding the blocks from the I-framc: 
means for predictiveiy encoding the blocks from the 

second frame of the PB-frame pair; 

means for bi-directionally predictiveiy encoding the 
blocks from the first frame of a PB-frame pair 
(B-blocks); 



10 

means for deriving a scaled forward motioa vector and a 

scaled backward motion vector for die B -block: 
means for obtaining a final forward modon vecror for the 

B-block by adding a delta motion vector co the scaled 

forward sorioa vector: and 
means for obtaining a anal badevard motion vector for 

the B-btcck by subtracting the delta motioa vector from. 

the scaled badevard morion vector. 



1 13. A method for encoding a 

2 sequence of video image frames comprising 

3 the steps of: 

4 dividing a source sequence 

5 into a group of pictures, each group of 

6 pictures comprising an I-frame followed by 

7 a plurality of P-frames and B-frames, 

8 dividing each I-frame, P-frame 

9 and B-frame into a plurality of spatially non- 

10 overlapping blocks of pixel data; 

n encoding a block in the I- 

12 frame independently from any other frames 

13 in the group of pictures; 

14 predictively encoding a block 

15 in a P-frame, based on the I-frame 

16 positioned before the P-frame or a previous 
n P-frame positioned before the P-frame; 

18 bi-directionally predictively 

19 encoding a block in a B-frame, based on the 

20 I-frame positioned before the B-frame or the 

21 previous P-frame and the P-frame positioned 

22 after the B-frame; 

23 deriving a scaled forward 

24 motion vector and a scaled backward motion 

25 vector for the block in the B-frame by 

26 scaling a motion vector of the block 
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27 
28 



predictively encoded in the P-frame 
positioned after the B-frame; 



29 obtaining a final forward 

30 motion vector for the block in the B-frame 

31 by adding a delta motion vector to the scaled 

32 forward motion vector; and 

33 obtaining a final backward 

34 motion vector for the block in the B-frame 

35 by adding the delta motion vector to the 

36 scaled backward motion vector. 

JE l 14. A method for encoding a 

fj 2 sequence of video image frames according 

C5 3 to claim 13, wherein the deriving step 

sJ 4 includes 

S 5 scaling of the forward and 

^ 6 backward motion vectors is based on a 

0 7 temporal reference of the P-frame and B- 

8 frame. 

1 15. A method for encoding a 

2 sequence of video image frames according 

3 to claim 13, further comprising the step of 

4 forming an encoded output wherein the 

5 encoded output is a bitstream comprising: 

6 temporal reference 

7 information for the B-frame and the P- 

8 frame; 



9 motion vector information for 

10 the block in the P-frame; 

11 quantized residual error 

12 information for the block in the P-frame; 

13 delta motion vector 

14 information for the block in the B-frame; 

15 and 

16 quantized residual error 

17 information for the block in the B-frame. 

1 16. A method for encoding a 

2 sequence of video image frames according 

3 to claim 15, wherein 

4 the output bitstream contains 

5 additional information indicating a presence 

6 of at least one of the delta motion vector 

7 information for the block in the B-frame; 

8 and the quantized residual error information 

9 for the block in the B-frame. 
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sive delay. Currently the motion vector for the blocks in the 
bi-directionally predicted frame is derived from the motion 
vector of the corresponding block in the forward predicted 
frame using a linear motion model. This however is not 
effective when the motion in the image sequence is not 
linear. The efficiency of this method can be f urther improved 
if a non-linear motion model is used. In this model a delta 
motion vector is added to or subtracted from the derived 
forward and backward motion vector, respectively. The 
encoder performs an additional search to determine if there 
is a need for the delta motion vector. The presence of this 
delta motion vector in the transmitted bitstream is signalled 
to the decoder which then takes the appropriate action to 
make use of the delta motion vector to derive the effective 
forward and backward motion vectors for the 
bi-directionally predicted block. 
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statements made on information and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the like so made are punishable by 
fine or imprisonment, or both, under 1 8 U.S.C. 1 001 and that such willful false statements may 
jeopardize the validity of the application, any patent issued thereon, or any patent to which this 
declaration is directed. 



Name of assignee 




Matsushita Electric Industrial Co., Ltd 




Signature of person signing for assignee 


Date 


Typed or printed name and title of person signing for assignee 


Dr. Osamu Yamazaki Director 





Burden Hour Statement: This form is estimated to take 0 1 hours to complete Time will vary depending upon the needs of the 
individual case. Any comments on the amount of time you are required to complete this form should be sent to the Chief 
Information Officer Patent and Trademark Office, Washington, DC 20231. DO NOT SEND FEES OR COMPLETED FORMS 
TO THIS ADDRESS. SEND TO Assistant Commissioner for Patents, Washington, DC 20231 
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REISSUE APPLICATION BY THE ASSIGNEE, 
OFFER TO SURRENDER PATENT 



Docket Number (Optional) 
MTS-880US1 



This is part of the application for a reissue patent based on the original patent identified beiow. 



Name of Patentee(s): 




Thiow Keng Tan 




Patent Number 


Date Patent Issued 


5,825,421 


October 20, 1998 


Title of Invention y^gg C0 DING METHOD AND DECODING METHOD AND DEVICES 


THEREOF 





Matsushita Electric Industrial Co . Ltd. is the assignee of the entire interest in the original patent. 
I offer to surrender the original patent. 



X] A certificate under 37 CFR 373(b) is attached. 



am authorized to act on behalf of the assignee. 



{ hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the like so made are punishable by 
fine or imprisonment, or both, under 18 U.S. C. 1001 and that such willful false statements may 
jeopardize the validity of the application, any patent issued thereon, or any patent to which this 
declaration is directed. 



Name of assignee 
Matsushita Electric Industrial Co., Ltd. 



Signature of person signing for assignee 



Date 



Typed or printed name and title of person signing for assignee 
Dr. Osamu Yamazaki Director 



Burden Hour Statement: This form is estimated to take 0.1 hours to complete Time will vary depending upon the needs of the 
individual case. Any comments on the amount of time you are required to complete this form should be sent to the Chief 
Information Officer, Patent and Trademark Office, Washington, DC 20231. OO NOT SEND FEES OR COMPLETED FORMS 
TO THIS ADDRESS. SEND TO: Assistant Commissioner for Patents, Washington, DC 20231. 



Practitioner's Docket No, MTS-880US1 



PATENT 



ASSENT BY ASSIGNEE FOR FILING OF REISSUE APPLICATION 

This is part of the application for a reissue patent filed herewith based on the original patent identified 
as follows* 

Name of Patentee: Matsushita Electric Industrial Co , Ltd. 

Patent Number 5,825,421 

Date Patent Issued: October 20 7 1998 

Title of Invention- VIDEO CODING METHOD AND DECODING METHOD 
AND DEVICES THEREOF 
I am an assignee owning an undivided interest to' the above original patent. 

I assent to the accompanying application for reissue 

Attached is a "Certificate under 37 C.F.R. section 3.73(b)" 

Matsushita Electric Industrial Co., Ltd. 



Date: 

Signature of person signing for assignee 

Dr. Osamu Yamazaki 
Director 



(Assent by Assignee for Filing of Reissue Application-page 1 of 1 ) 



MTS-880US1 PATENT 
IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



Applicant: T. Tan : Art Unit: 

Serial No.: To Be Assigned : Examiner: 

Filed: Herewith 

FOR: VIDEO CODING METHOD AND 
DECODING METHOD AND DEVICES 
THEREOF 



CERTIFICATE UNDER 37 CFR 3.73 (b) 

Assistant Commissioner for Patents 
Washington, D.C. 20231 

SIR : 

Matsushita Electric Industrial Co., Ltd., a Japanese Corporation 
certifies that it is the assignee of the entire right, title and interest in the patent 
application identified above by virtue of an assignment from the inventor of the 
patent application identified above. The assignment was recorded in the Patent 
and Trademark Office at Reel 8607, Frame 0024, for which a copy thereof is 
attached. 

The undersigned has reviewed all the documents in the chain of 
title of the patent application identified above and, to the best of undersigned's 
knowledge and belief, title is in the assignee identified above. 

The undersigned (whose title is supplied below) is empowered to 
act on behalf of the assignee. 

I hereby declare that all statements made herein of my own 
knowledge are true, and that all statements made on information and belief are 
believed to be true; and further, that these statements are made with the 
knowledge that willful false statements, and the like so made, are punishable by 
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fme or imprisonment, or both, under Section 1001, Title 18 of the United States 
Code and that such willful false statements may jeopardize the validity of the 
application or any patent issuing thereon. 

Date : 



Name :Dr. Osamu Yamazaki 



Title : Director 




AUGUST 14, 1997 

PTAS 

RATNER Sc PRESTIA 
ALLAN RATNER 

SUITE 301, ONE WESTLAKES BERWYN 
P.O. BOX 980 . 

VALLEY FORGE, PA 19482-0980 



UNITED STA DEPARTMENT OF COMMERCE 
Patent and Trademark Office 

ASSISTANT SECRETARY AND COMMISSIONER 
OF PATENTS AND TRADEMARKS 
Washington, D.C. 20231 
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UNITED STATES PATENT AND TRADEMARK OFFICE 
NOTICE OF RECORDATION OF ASSIGNMENT DOCUMENT 

THE ENCLOSED DOCUMENT HAS BEEN RECORDED BY THE ASSIGNMENT DIVISION OF 
U.S^ PATENT AND TRADEMARK OFFICE. A COMPLETE MICROFILM COPY IS AVAIL? 
AT 'lHE ASSICrNiiJiJNT S&ARCrf KOUi-i THE REEL AND FRAME NUMBER REFERENCED 
BELOW. 



o 



THE 



PLEASE REVIEW ALL INFORMATION CONTAINED ON THIS NOTICE. THE INFORMATION 
CONTAINED ON THIS RECORDATION NOTICE REFLECTS THE DATA PRESENT IN THE 
PATENT AND TRADEMARK ASSIGNMENT SYSTEM . IF YOU SHOULD FIND ANY ERRORS OR 
HAVE QUESTIONS CONCERNING THIS NOTICE, YOU MAY CONTACT THE EMPLOYEE WHOSE 
NAME APPEARS ON THIS NOTICE AT 7 03-308-9723. PLEASE SEND REQUEST FOR 
CORRECTION TO: U.S. PATENT AND TRADEMARK OFFICE, ASSIGNMENT DIVISION, 
BOX ASSIGNMENTS, NORTH TOWER BUILDING, SUITE 10C35, WASHINGTON, D.C. 20231. 



RECORDATION DATE: 07/15/1997 REEL /FRAME : 8607/0024 

NUMBER OF PAGES: 3 

BRIEF: ASSIGNMENT OF ASSIGNOR'S INTEREST (SEE DOCUMENT FOR DETAILS). 

ASSIGNOR: 

TAN, THIOW KENG DOC DATE: 03/03/1997 

ASSIGNEE: 

MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD. 
10 06, OAZA KADOMA, KADOMA-SHI 
OSAKA, JAPAN 571 

SERIAL NUMBER: 08773574 FILING DATE: 12/27/1996 

PATENT NUMBER: ISSUE DATE: 



MAYA BENNETT, EXAMINER 
ASSIGNMENT DIVISION 
OFFICE OF PUBLIC RECORDS 



ASSIGNOR(s)/ 
INVENTOR(s) 



Assignee 

j^Full Name 
Quid address) 



No legalization required 



ASSIGNMENT 



WHEREAS, the ASSIGNOR, comprising the following named inventor(s) 



Inventor(s) 

1. Tan, Thiow Keng 



has made an invention endued: 



2. 
4. 



VIDEO CODING METHOD AND DECODING METHOD AND DEVICES THEREOF 

and has executed an application for Letters Patent of the United States 
concurrently herewith; 

WHEREAS, the ASSIGNEE 
Matsushita Electric Indus! :ia, Co. , Ltd. 



of 1006, Oaza Kadorna, Xadoma-shi, Osaka 571 JAPAN 



is desirous of acquiring the entire interest in and to said invention and the 
Letters Patent to be obtained therefor, 

NOW, THEREFORE, in consideration of the payment by ASSIGNEE to 
ASSIGNOR of a sum corresoonding to One Dollar ($1.00), and for other good 
and valuable consideration, the receipt of which is hereby acknowledged, 
ASSIGNOR, intending to be Iegaily bound, hereby sells, assigns and transfers 
to ASSIGNEE, its successors and assigns n& full and exclusive right, dtle and 
interest in and to said invention, iil applications for Letters Patent for said 
invention, including all divisions and -y ntinuations thereof, all rights to claim 
priority based thereon, md all Letters Patent, including reissues, to be obtained 
therefor, including any and all foreign patent rights in this invention 
corresponding thereto. 

ASSIGNOR hereby warrants ttvt no assignment, sale, agreement or 
encumbrance has been or will be mace or entered into which would conflict 
with this Assignment. 
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ASSIGNOR agrees it shall be legally bound, upon request of the 
ASSIGNEE or its successors or assigns or a legal representative thereof, to 
supply all information and evidence of which the ASSIGNOR has knowledge or 
possession, relating to the making and practice of .said invention, to testify in 
any legal proceeding relating thereto, to execute all instruments proper to patent 
the invention in the United Smts of America and foreign countries in the name 
of the ASSIGNEE, and to execute all instruments proper to carry out the intent 
of this instrument. 

If the invention requires a biological deposit, ASSIGNOR also grants to 
ASSIGNEE such control over any deposit made by ASSIGNOR as may be 
necessary to the validity of the paten: rights assigned herein. 

ASSIGNOR authorizes ASSIGNOR'S attorney to insert at the end hereof 
the serial number and filing date of the aforesaid application for United States 
Letters Patent and/or the Attorney docket or file designation for this application. 

If the ASSIGNOR includes more than one individual, these obligations 
shall apply to these individuals both individually and collectively. 

IN WITNESS WHEREOF, this Assignment is executed on the day 
indicated below. 

(Typed or Printed Name) (Signature) (Date) 

SIGNATURE 1. Tan, Thiow Keng ^^^^^w March 3, 1997 

2. 

3. 

4. 



Application for United States Letters Patent 

Serial No. 08/773,574 Filed Dace -o^r 27 « 19So 
Attorney Docket No. jJ _• 



